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1. Introduction 



Q I The minority game (MG) has attracted much interest in the statistical physics 

^ ' community over the past years. It models a simple market in which the trading agents at 

each time-step have to make a decision whether to buy or sell based on publicly available 
rS ' information, such as the past market-history, political circumstances, the weather forcast 

c^ I etc. Each agent aims to make profit by making the opposite choice to the majority of 

agents. The interaction between the agents is indirect, the players cannot identify the 
actions of individual other agents, but react to the total cumulative outcome of all 
actions in the market. In order to take their trading decisions each agent holds a pool of 
strategies, which can be understood as look-up tables, mapping the value of the publicly 
available information onto a trading decision. The identification of the best strategy is 
based on virtual scores the agents allocate to each of their strategies in order to keep 
track of their performance. At each round of the game each agent updates the score 
of each of his or her strategies, increasing the scores of strategies which would have 
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predicted the correct minority decision. Exhaustive reviews on MGs can be found in 

[ma- 

Although the update rules seem simple, the MG displays remarkably complex 
features. The behaviour of the fluctuations of the total bid, the so-called volatility 
is non-trivial [SI El 13 IH E] and a phase-transition separating an ergodic and a non- 
ergodic phase was identified fOl 13 ^1 E] ■ The main control parameter in MGs is the 
ratio a = P/N of the number P of possible values for the public information over the 
number N of players. 

From the point of view of statistical mechanics, the MG is an extremely interesting 
model. It contains the ingredients of a disordered mean-field system and can be 
approached with the techniques of spin-glass physics, if the thermodynamic limit of 
an infinite number of players is considered. 

Although the model lacks detailed balance, it was shown that the stationary state 
of the adaptive dynamics can be captured by the minima of a disordered Hamiltonian 
if for a > ttc = 0.3374... [T2j. Its ground states were calculated using the replica 
method El CHI, and the location of the ergodic/non-ergodic phase transition, Oc, 
was identified analytically as the point where the static susceptibility obtained within a 
replica-symmetric ansatz becomes infinite. While replica symmetry is not broken even 
in the non-ergodic phase of the standard MG, later studies of MGs in which the agents 
correct for their own contribution to the total bid then revealed the presence of phases 
with replica symmetry breaking P^ . 

Dynamical studies of the MG have been conducted in |H1 IHI using the exact 
generating functional technique of |I5J, and enabled a full understanding of the game 
in the ergodic phase. The phase transition in the standard MG was identified as the 
point a = ac where the assumption that the dynamical susceptibility (or integrated 
response function) be finite breaks down. A review of dynamical analyses of MGs can 
be found in [T^. It was also shown that MGs with market-impact correction exhibit a 
different type of phase-transition [17^. While the integrated response remains finite in 
such models, long-term memory was identified as the source of ergodicity breaking, and 
it was seen that the onset of long-term memory coincides with the AT-line, at which 
the replica-symmetric solution becomes unstable [13 HH] • 

On the technical level the MG is closely related to the Hopfield model of neural 
networks ^H], the update rules of the MG are similar to 'anti-Hebbian' learning rules 
of neurons. While the quenched patterns in the Hopfield model form attractors of 
the learning dynamics, the agents in the MG try to avoid such fixed points. Up to 
an additional random field the above Hamiltonian of the MG is therefore essentially 
identical to the Hamiltonian of the Hopfield model with negative sign. The energy 
landscape of a suitably defined majority game coincides with that of the Hopfield model, 
although the dynamical rules of the game differ from the Glauber dynamics considered 
in neural networks ^Hj- The possibility of retrieval states in majority games is discussed 
in [2n|. 

In analogy to work on dilute neural networks, in which not every neuron is connected 
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to every other neuron, we study the effects of dilution on the phase behaviour of the 
MG in this paper. We restrict ourselves to the case in which the average number of 
connections per agent scales with the number of agents in such a way that it becomes 
infinite in the thermodynamic limit as opposed to the case of finite connectivity. In 
terms of the decision making of the agents this corresponds to a game in which the agents 
do not use the global aggregate bid to update the scores of their strategies, but only 
the cumulative bid of an individual subset of neighbours to which they are connected. 
Related games in which players adjust their decisions dependent on the behaviour of 
agents in a local neighbourhood have been discussed for example in \21\ 1^ 1^. MG- 
type models with inter-agent communication on random graphs have also been studied 
analytically using a so-called 'Crowd- Anticrowd Theory' in P^I25j . 

2. Model definitions 

Before introducing the dilution we will briefly recall the dynamical rules of conventional 
MGs as studied for example in |S1 EE] ■ The N agents in the MG will be labelled with 
Roman indices. At each round t of the game each agent i takes a trading decision 
bi{t) G IR (a 'bid') in response to the observation of public information //^(t)- While 
in the original version of the MG the information coded for the actual market history 
P7| I2H] we will here assume that fi{t) is chosen randomly and independently from a 
set with P = aN possible values, i.e. fi{t) e {!,••• ,aN}. This is the so-called MG 
with random external information. One then defines the rescaled total market bid at 
round t as A(t) = N^^^'^J^ibiit). Each agent i holds a pool of S" > 2 fixed trading 
strategies (look-up tables) Rj^ = {Rjay • • • ; RjD^ with a = 1, . . . , S. If agent i decides to 
use strategy a in round t of the game, his or her bid at this stage will be bi{t) = R^^ . 
All strategies Rja are chosen randomly and independently before the start of the game; 
they represent the quenched disorder of this problem. The behaviour of the MG was 
found not to depend much on the value of 5" |2Zl 121] , nor on whether bids are discrete 
or continuous jlj. For convenience, we choose S = 2 and Rj^ G {—1, 1}^ in this paper. 
The agents decide which strategy to use based on points Pia(t) which they allocate to 
each of their strategies. These virtual scores are based on their success had they always 
played that particular strategy: 

pUt + l)=P^a{t)-R:i'^A{t). (1) 

Strategies which would have produced a minority decision are thus rewarded. At each 
round t each player i then uses the strategy in his or her arsenal with the highest score, 
i.e. bi{t) = R^^L), where ai{t) = arg m.ax^pia{t). For S = 2 the rules (jT} can then be 
simplified upon introducing the point differences gj(t) = ^[pii{t) — pi2{t)]. Thus agent i 
plays strategy Rji in round t if qtit) > 0, and Rj2 if qi(t) < 0, so that his or her bid in 
round t reads 6j(t) = u^' +sgn[qi{t)]Ci , where a;, = i[Rii + Rj2] and ^j = i[Rii-Ri2]- 
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The above update rule for the score differences {qi} can be written as 



qiit + l) = q,{t)-i 



flit) 



^m 



J2^f'Sn[qM 



(2) 



with O = N~^^'^^.ujj. Equation (j2)) defines the standard (or so-called 'on-line') MG. 
Alternatively, it is common in studies of the MG to define the dynamics in terms of an 
average over all possible values of the external information in 0- This corresponds to 
updating the {q^} only every 0{N) time-steps, and leads to the the so-called 'batch' 
MG IB]: 



q,{t + l) = q,{t)~-\2 



E^'^^^w + E^" 



-; 



.M=l 



tl=l 



(3) 



Here Sj{t) = sgn[qj{t)]. We can now introduce a dilute version of the batch MG by 
modifying the update rules as follows: 

p p 



g,(t + l) = g,(t)--E 

j 

Here, the c,;, G {0,1} {i,j = 1,. 



Cij 



-.1 ^j 



(4) 



-jj 



A^) are additional quenched random variables. 
As before the disorder corresponding to the strategy assignments is contained in the 
variables {^f , tuf }. c is a new control parameter and denotes the probability for a given 
link Cij to be present, P{cij = 1) = c. It hence controls the degree of dilution, on average 
any given agent is connected to cN other agents. For c = 1 the fully connected batch 
MG is recovered. In the context of neural networks the limit liniAr^oo c = 0, while still 
limjv^oo cA^ = CX3 is often referred to as the 'extremely dilute' limit [3niEIlE2]t- We 
will specify the further details of the distribution from which the {cij} are drawn below. 

In terms of the updating of strategy scores the dilution means that a given 
agent i no longer uses the total re-scaled bid A{t) = N~^/'^Ylij^j{^) to evaluate the 
performance of his or her strategies, but takes into account only the cumulative bid 
Ai{t) = N~^^'^J2{j-Cij^o}^i(^) °^ t^^ agents j to which he or she is connected, i.e. for 
which Cij = 1. Such so-called 'local' MGs and related models have been studied in 
PH 123 1^ I2H] • In local MGs the perceived market history may be different for different 
agents. Accordingly, if the information given to the agents is based on the real-market 
history, different agents should potentially receive different pieces of information. In the 
remainder of this paper we will not focus on interpreting the dilute MG in terms of real 
markets, but will restrict ourselves to the statistical mechanics analysis of the model 
defined by the update rule (JD). 

It remains to specify the distribution from which the dilution variables {cij} are 
drawn. We will choose Ca = 1, and will assume that Cki is independent of Cij whenever 

I Note that our definition of c differs from the one used in |30[ IST| by a factor of N. There c denotes 
the average number of connections per neuron, and hence the extremely dilute limit corresponds to 
linijv^oo cN~^ = and limjv^oo c = oo. The notation of I^OI \'M\ is more convenient if the case of 
finite-connectivity is considered. 
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{k,i) ^ {{i,j),{j,i)}. The parameters characterising the distribution of the dilution 
variables are then the expectation value and covariance 

C = (Qi)c = (Cii)c . {c^jCj^)^ - C^ = Tc{l - c), (5) 

note that the {cij} only take values and 1 so that (c^^) = c. We write averages over 
the dilution variables as (. . .)^. The parameter F controls the symmetry of the dilution 
and allows for a smooth interpolation between the case of fully symmetric dilution 
Cij = Cji for r = 1 and the fully uncorrelated case F = 0, where Cy and Cji are chosen 
independently. If c = 1, then all the links are present and F becomes meaningless. In 
closed form the corresponding distribution for any pair Cij, Cji with i < j can be written 
as 

P{cij, Cji) = c [c (1 - F) + F] Sc,j,iScj,,i 

+ c(l - c)(l - F) (5,,„i5,^,,o + 4,,o4,.,i) 

+ (1 - c) [(1 - c) (1 - F) + F] 5,,^,o(5,^„o. (6) 

Taking into account that on average there are cN connections per agent, the appropriate 
control parameter is now a = P/{cN), where P is as before the number of possible values 
of the information, i.e. we have fi & {1, . . . , acN}. 

3. Dynamics 

3.1. Generating functional and single effective agent process 

We will start by studying the dynamics of the dilute batch minority game. The now 
standard approach is based on dynamical functionals [SI 12^1 and has been applied to 
different versions of the MG in [TTl ESI 1201 ESI El] • Before we introduce the generating 
functional let us re- write the update rule (jl)) as follows 

g,(t + 1) = q,it) - J2 J^Mt) - E ^^.- + ^^(^)' (^) 

j j 

where we have introduced the shorthands 

and have added the perturbation fields {Oi{t)} to generate response functions. 
The dynamical partition function is then introduced as 

DqDqpo{q{0))exp (tJ^UtMit+l) - q^{t) - Oiit)) 

\ it / 

X exp It Y, m [Yl -^^^'^^ + E ^'.- ) ) ^^p y E ^^ wv^^(^) 1 > (9) 

\ it \ j j J J \ it 
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where DqDq = Y[itdqi{t)dqi{t)/{2TT), and with poiqiO)) the distribution of the starting 
values {qi{0)}. Once the disorder-averaged generating functional Z[il)] has been 
calculated correlation and response functions can be computed by taking suitable 
derivatives with respect to the source and perturbation fields 4'i{t) and 9i(t), respectively. 

Carrying out the average over the quenched disorder in © requires a lengthy, 
but standard calculation. One first averages over the dilution variables {cij} and then 
proceeds along the lines of |H] in order to perform the average over the {^f } and {i^f }, 
i.e. over the strategies assigned at the beginning of the game. We will not report the 
details of the calculation here, but refer to jHOl |S2I where similar averaging procedures 
are discussed in the context of dilute neural networks. 

As usual the evaluation of Z[il)] converts the original system ^ oi N coupled 
Markovian processes into an equivalent effective non-Markovian process for a single 
representative agent. After setting the source fields ipi(t) to zero and assuming that 
6i{t) = 6{t) for all i we find the following single effective agent equation 



q{t + 1) = q{t) - «(1 - c)s{t) + e{t) - «c2^(I + G)-^}s{t') 



+ ra(l - c) ^ Gtt'sit') + e{t) + v^r/(t), (10) 

t' 

where s(t') = sgn(g(t')). ri{t) is Gaussian noise with zero mean and temporal correlations 
given by 

{vitUt'))^ = c ((I + G)-\E + C)(I + G^)-^)^, + (1 - c)(E + C),..(ll) 

I denotes the identity matrix, \u' = ^w-, while E has all entries equal to one, Eui = 1. 
The matrices G and G are the dynamical order parameters of the problem and have to 
be determined self-consistently according to 

Gu' = {sit)sit'))^, Gu' = (^^'j , (12) 

where (. . .)^ denotes averages over the single-agent noise {ri(t)}. This procedure is exact 
in the thermodynamic limit N —>■ oo and the order parameters G and G can be identified 
with the disorder-averaged correlation and response functions of the original multi-agent 
batch process 

Gw = jim N-' J2 {^^itMt')),atHs (13) 

i 

G.-'^iL-'v-'EaslTyWi)),.,.. (14) 

Eqs. flTUl im IT^ define a self-consistent problem to be solved for the macroscopic 
observables G and G. We note that the symmetry parameter F is irrelevant in the case 
of full connectivity, c = 1 and that the single-effective agent problem reduces to that of 
the standard batch MG in this limit. Because of the retarded interaction-terms and 
the presence of coloured noise, a full analytical solution is in general not feasible beyond 
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the first few time-steps. Alternatively one can resort to a Monte-Carlo integration of the 
single agent-process using the procedure of [32] • This method allows to determine the 
correlation and response functions numerically without finite-size effects, but becomes 
more and more costly as the number of time-steps is increased. 

3.2. Stationary state 

We now proceed to study the stationary states of the single-effective agent process. We 
make the common assumptions of time-translation invariance 

lim Ct+r,t = C{t), lim Gt+r,t = G{t), (15) 

i— >oo t— >oo 

finite integrated response 

lim VG^,, =X<oo (16) 

t'<t 

and weak long-term memory 

lim Gw = W finite. (17) 

t— >oo 

Under these assumptions we can follow ^ and perform an average over time of (fTU)) . 
One defines s = limT-_^oo t^^ J2t<T sgii[q'(t)] as well as g = limj^oo (l(t)/t and obtains after 
setting e{t) = 

q = -Rs + ^/^T], (18) 

where we have defined 

rvr 

R=-a{l-c)irx-l) + -^. (19) 

1 + X 

rj = limT-_^oo T~^ '^t<T ^i^) ^^ ^ Gaussian random variable with zero- mean and variance 

y = W).=c^^ + il~c)il + Q), (20) 

where we have introduced the persistent correlation Q = lim^^oo t^^ J2t<T ^(^)- 

Now, as usual in studies of MGs we can distinguish self-consistently between so- 
called 'frozen' and 'fickle' agents. The representative agent is frozen and keeps playing 
the same strategy if \q(t)\ -^ cx) asymptotically, so that q ^ 0. In this case one has 
s = sgn[g]. Provided that R > this is easily seen to be the case if \ri\ > Rj ^^. On 
the other hand the effective agent is fickle and keeps switching between both of his or 
her strategies when g = 0, which is the case if \r]\ < R/y/a. In this case s = {^/a/R)rj. 
Given Q = (s^)^, the persistent part of the correlation function can then be computed 
self-consistently from 

Q= {e{\v\-R/V^)), + (e{R/V^-\v\)^ 
= <P + (e{R/V^-\v\)^\ , (21) 
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1 F^ 




Figure 1. Persistent correlation Q as a function of a. Markers are simulations for 
r = 1 (circles), F ~ 0.5 (squares) and F = (diamonds). The solid lines are the 
theoretical predictions for the phase with weak long-term memory, they have been 
continued as dashed lines below the transition, where they are no longer valid. Vertical 
dashed lines mark the onset of memory for F = 0.5 and F = 1, respectively. No 
transition is predicted for F = 0. Left: c = 0.5. Simulations are performed for N = 500 
players, measurements are taken over 250 time-steps preceded by 250 equilibration 
steps. The results are averaged over 10 realisations of the disorder. Right: Limit of 
extreme dilution, c — (simulations are for N = 1000 players with c — N^^^^, 20 
disorder samples). 



where 9(t) is the step-function, 9(t) = 1 for t > and 9(t) = otherwise. = 
{9 {\ri\ — R/^/a))^ denotes the fraction of frozen agents. On the other hand, only fickle 
agents contribute to the response function asymptotically and we have 

1-d) 



x^-L(«(«/ySH.,l)| 



R 



(22) 



Explicitly performing the Gaussian integrals over r] in ()21|) then leads to the following 
two non-linear, but closed equations for Q and x'- 



Q = 1 + erf 



R 



V2aY 



faY 



Tl R 



X 



R \-j2aY) 



l--f''*)' 



exp 



R^ \ 
2aY) 



(23) 
(24) 



The fraction of frozen agents reads < 

The system fE!?| El} reduces to the corresponding equations of the standard batch 
MG [8^ in the limit c = 1. It can be solved numerically for any fixed values of the 
parameters < c < 1 and < F < 1 to obtain the order parameters Q and x 
as a function of a. We compare the analytical results for the persistent part of the 
correlation function with numerical simulations in Fig. ^ Here, the extremely dilute 
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limit lim7v-»oo c = 0, limAr_,oo cN = oo has been simulated by setting c = A^~^/^. We find 
near perfect agreement for large values of a, but for F > systematic deviations are 
observed in the low-a region. Using the method of [^EI we have performed an explicit 
iteration of the single-agent equation to confirm that the deviations for small values of 
a are not artifacts due to a finite number of agents in the simulations. 

In the standard MG, c = 1, the breakdown of the ergodic theory is associated 
with the onset of anomalous response, i.e. the violation of the assumption that the 
integrated response x be finite. At the same time one expects that the assumption of 
weak long-term memory is broken as well jSZj- No singularities are found, however, in 
the numerical solution of (J2SII21) for c < 1. Since no signs of ageing are found in MGs, 
we are lead to the conclusion that the assumption of weak long-term memory breaks 
down below a critical value of a, whereas x remains finite. We will refer to this as the 
onset of memory, similar behaviour was observed in batch MGs with market-impact 
correction |17j . 

3.3. Onset of memory and phase diagram 

We will now proceed to identify this onset of memory analytically. To this end we 
follow the lines of ^\ and separate time-translation invariant (TTI) contributions to 
the response function from the non-TTI parts and write 

MmGw =G{t-t') + Gu'. (25) 

t—*oo 

While perturbations in the initial stages of the dynamics might infiuence the final state 
of a given agent, we expect that the effect becomes independent of t eventually, so that 
we assume limt^oo Gw = G{t'). In the stationary state, the point differences of frozen 
agents have become large so that only fickle agents are affected by perturbations applied 
at later times. This is accounted for by G. Hence we expect that lim(/_^oo G{t') = |17j . 
Assuming furthermore that G is small we expand the single-effective agent process to 
first oder in G and find 

q{t + 1) = q{t) - a(l - c)s{t) - ac J](I + G)~}s{t') + Ta{l - c) J] Gtt's{t') 

t' t' 

oo n—1 

+ 9{t) + v^r^(t) + acY,Y.Y. [(-G)"G(-G)"-™-i] ^^^ s{t') 



t' n=0 m=0 



+ Ta{l -c)J2 G{t')s{t') + 0{G^). (26) 

t' 

Writing x = Xlt G{t) one then has after averaging over time 

q = — a(l — c)s h ra(l — c)xs + ^/ar] 

1 + X 

oo rt— 1 

+ «c E E(-*)™ E ^(^') J2(-G)t'i'r"'s{t") + Tail -c)J2 G{t')s{t'). (27) 

n=0 m=0 t' t" t' 
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7 



oo n— 1 



v^^E E(-^)™ E ^(^') E(-^)^*^''"~'^*"* 



n=0 m=0 



+rv^{i -c)Y,Git')Gt,t 



f28) 



where we have introduced 7 = v^(l — c)(l — Fx) + y/ac/{l + x)- 

We now define x = St ^l'^)' ^^'^ after summing over t and re-organising the terms 
we finally find to first order in G 



X 



X 
a— 

7 



+ r(i 



x + o{G' 



(29) 



[i + xy 

Although X = is always a solution, a bifurcation occurs when the following 
condition is fulfilled 



Vax 



+ r(i-c) 



7, 



(30) 



[I + X)' 

so that non-zero solutions for x become possible. For fixed F this condition marks the 
continuous onset of long-term memory and defines a line in the (a, c)-plane. We will 
refer to this line as the memory-onset (MO) line in the following, and will discuss the 
resulting phase diagram in section El 

An intuitive argument for the different type of phase transition of the dilute MG 
as compared with the fully connected model can be based on a simple geometrical 
explanation of the transition in the fully connected standard MG jHl EH]- In the 
stationary state only the (1 — (f))N fickle agents contribute to the integrated response 
X, as perturbations do not affect frozen agents. Now from Eqs. (j21) and Q one realizes 
that the A^-dimensional vector q = (gi,...,g7v) moves in the space spanned by the 
P = aN vectors $,^ = (^f, . . . ,^^). If P > (1 — 4>)N this space is certain to contain 
the homogeneous perturbation 6i = 6, and any small perturbation in this direction will 
be washed out over time. If, however, P < {1 — (f))N then the whole space is no longer 
spanned by the {^^} and some perturbations can not be removed so that the integrated 
response diverges at the value Oc of a, at which ac = 1 — 0(«c), which is exactly what 
is found in the fully connected MG jHl IHl CDl- In the dilute case (JD) the vector q no 
longer moves in the space spanned by the {^^}, as the agents use local bids Ai{t) to 
update their strategy scores. From this argument it is plausible that the phase transition 
marked by an onset of diverging integrated response is no longer found as soon as c < 1. 
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4.I. General replica theory 

We will now turn to the analysis of the statics of the dilute version of the MG. By 
considering a continuous time limit of the update rules of the standard MG is it possible 
to show that the stationary state in the ergodic regime a > ac corresponds to minima of 



M=i 



^-^i.i ^i >'ji 



+ 2E.,eM'^. + E^-^-^ro.^ 



'«j 



the disordered function Hi = (1/-P) Yl 
011]. The variables 0j G [—1, 1] are the average asymptotic values of Sj(t) so that the 
corresponding agent is frozen whenever 0j = ±1 and remains fickle for — 1 < 0j < 1. 
We generalise the above function to the case of dilution and introduce 



H. 



1 
2a 



Ei-^^ 



6, + 2/1^^ 



+ ^a 



(31) 



Here we use the same definitions for Jf • and h^j as in the analysis of the dynamics, and 
introduce new variabes Kf- = —% V,, _i cufa;!". 

''J C iV ^ — ^ (J- — J- *■ J 

As usual in disordered systems it is in general not possible to find a Hamiltonian 
which is minimised by the dynamics in the case of asymmetric couplings. Therefore, we 
have to restrict this section to the case of fully symmetric dilution, Cij = Cji, i.e. we will 
assume F = 1 in the above distribution © of the connectivity variables. 

In order to minimise the above function H in terms of the variables {(pi}, we resort 
to the replica method and compute the disorder- average of the replicated partition 
function 



n 



exp 



2a 



EEi^^ 



^1 + 2/.^. 



^ + K^j} 



(32) 



at some 'annealing temperature' /3 ^. 
superscript a is a replica index, a = 1 



We will eventually take the limit /? — > oo. The 
. . . ,n. The minima of He are then found as 

Z"-l 



mm 



u\Hc = — lim lim lim . (33) 

The computation of Z" is again lengthy, but straightforward and is essentially a 
combination of the corresponding calculations for the fully connected MG El ^] 
and replica analyses of dilute neural networks [SU E2] . We will therefore only report the 
final result: 



I DQDSexp {-PnNfiQ, S) + 0{N^) + 0{n^)) 



(34) 



with DQ = nafe[viVc?Qab/v27r] and similarly for DS. Here the replicated 'free energy' 
is given by 



fiQ^S) = -^logdetT+ |^^^,,Q,, - ^^°S J'^ [U'^r] exp f ^$^^a.0^ 



2pn 



4an^ 



:i-c 



7 ^ QabQ 



ab 



-' 2n 5Z^" 



a 2n 



Y^Qa 



1-C 



(35) 



ah 
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Q is the overlap-matrix defined by Qab = N'^ J2i 4''i4'\i and the Sah are the conjugate 
Lagrange multiphers. The n x n-matrix T is given by Tab = (^at + „(! + Qab)- 

4-2. Replica symmetric ansatz 

We will now make a replica symmetric ansatz corresponding to the assumption of 
ergodicity in the dynamics and will set 

Qab = q+iQ - q)Sab, Sab = S + {S - S)5ab- (36) 

Insertion into (P3|) and taking the limit n ^ gives the replica-symmetric free- 
energy 



fB.siQ,S) = ^\og 



l + -{Q-q) 
a 



+ ^{SQ-sq)-^ 



ac (1 + g) 
^ 2 a + PiQ-q) ^ ' 

log /" d<j)exp{-(3VM) 

- f (1 - c){Q' - q') - "—^Q + f{l -c){q-Q)+ ^—^, (38) 

Aa I la I 

where Vz{4>) is an effective potential defined by K(0) = —^J^zt^ — ^{S — s)(j)^. {. . .)_, 
denotes the average over the standard Gaussian variable z. 

The integrals in (|34j) are then performed by the method of steepest descent in 
the thermodynamic limit and the corresponding saddle-point equations are obtained by 
working out the variations of fas with respect to the parameters Q, q, S and s. Similar 
to [in] one finds 

^^(a + ^(Q-g))2 + ^(' + ^) ('') 

Q = {{<^'\^),\ (40) 

f^iS-s) = - ^ ' , +^^(g-g) + ^^ (41) 

a + p[Q — q) a"^ a 

f3{Q - q) = ^ (z {<P\z) ) . (42) 



In these expressions we have introduced the average 

/^,#/(0)exp(-/?V;(0)) 

J_^rf0exp(-/3K(0)) 

We will be looking for solutions with lim^_+oo Q = lini/3_+oo q and hm^j^^oo S = lim^j^oo s 
and will also use the quantities 

X = -iQ-q), C = -x[^PiS~s), (44) 

a \ s 

which will remain finite in this limit. The remaining averages over are easily evaluated 
in the limit (3 ^ oo as the corresponding integrals over are dominated by the minimum 
of the potential ^(0) in G [—1,1]. We find that the minimum is at = 1 for z > ( 
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and at = — 1 for z < —(. This is the analogue of the corresponding condition on 
the time-averaged single-particle noise for frozen agents in the generating-functional 
calculation. For —( < z < ( the minimum is found at = z/(, so that the agent is 
fickle. Working out the remaining integrals we then find the following two equations for 
the order parameters x and Q fU^: 

V^sPiQ -q) = ^erf (-^^ . (46) 

In order to make contact with the results obtained from the analysis of the dynamics 

we define 

rvc 
R= - a^P^S -s) = -a(l - c)(x - 1) + —— (47) 

1 + X 

Y = »'s = ^(TT^ + (1 - c)(l + Q) (48) 

so that C = R/voY and find 

[2VaY f R^ \ f aY\ J R \ 

^ ^ 'r-' (tIf) • <^°* 

Note that this set of equations is identical to the one found from the dynamics (cf. 
for the case of fully symmetric dilution, F = 1. Finally, the replica symmetric 



free energy (jTTj) can be simplified upon using the saddle-point equations and we find: 

Jim Irs = ^7^^ + ^ (1 + Q) (1 - 2x) • (51) 

/3^oo 2(l + x)^ 2 

We compare this prediction of the replica-symmetric theory with simulations in Fig. 

121 and find very good agreement in the phase with only weak-long term memory. For 

c = 1 the result of Eq. (j5ip reduces to the replica-symmetric free energy of the fully 

connected model as reported in [lOj. Note that in this case Hc=i can be identified as the 

so-called predictability of the market and is a positive definite quadratic form and hence 

non-negative. A similar interpretation of He is not straightforward in the dilute model, 

and in particular H,, need not be non- negative for c < 1. It is however instructive to 

study the predictability 

P N 

H = JL- ? E (^1/^)' = JL- ^ E E(-r + »)K + ^^<p.) (52) 

^l=l fi=i ij 

also for the case c < 1. Here {A\ij) denotes an average over the total bid conditioned 
on a pattern /i in the stationary state 1101 13] . We display data from simulations in Fig. 
ini An analytical result for the predictability in the ergodic state of the fully connected 
batch MG is given in jHj and reads 

ff^iyii^. (53) 

2(l + x)= 
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Figure 2. Left: stationary value of the 'energy' He as a function of a for c = 1 
(circles), c = 0.75 (squares), c = 0.5 (diamonds) and c = (triangles). Data for c > 
are from simulations with N — 500 agents, run for 500 time-steps and averaged over 20 
realisations of the disorder. Data for c = is for N ~ 1000 and 10 realisations. Right: 
zoom for large values of a, the solid lines arc the predictions of the replica-symmetric 
theory, Eq. l(HT)l . the vertical dashed lines mark the onset of the AT-instability, see 
Eq. ^ 



We note that this expression can carried over to the dilute case c < 1 and that the 
numerical data agrees very well with the prediction of (jKH|) . see Fig. IH^. 

While the two phases in the fully connected model correspond to Hc=i = in the 
regime of low a and to a predictable phase {Hc=i > 0) above a^c = 1) = 0.3374 . . ., 
we observe that no unpredictable (or so-called symmetric) phase is present for dilution 
parameters c < 1. Although Fig. El only depicts results for some combinations of the 
parameters c and F, we have verified that H is strictly positive also for other values of 
F as long as c < 1. This absence of a symmetric phase with vanishing predictability is 
also observed in MGs with market impact correction |4H IHj . 



4-3. Calculation of the AT -line 

We will now study the stability of the ground states of He obtained within the replica- 
symmetric approximation against small fluctuations which break replica-symmetry. To 
this end we follow the procedure flrst proposed by de Almeida and Thouless jl21 and 
study the eigenvectors of the matrix of second derivatives of the free energy with respect 
to the {Qah\ and {Sab\- This results in an instability condition marking the onset of 

§ In the fully connected case the same expression for the predictability H = Hc=i can also be obtained 
from the replica analysis of the statics, as mentioned in the main text. Note, however, that the result of 
[H] is obtained from a generating functional analysis of the dynamics of the fully connected game. Eq. 
(|58|l therefore applies not only to the case of symmetric interactions between the agents, but also for 
arbitrary symmetry parameters F < 1 (where no replica theory is available due to the lack of symmetry 
in the couphngs {Jfj}). 
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Figure 3. Predictability H as a function of a for (c = 0,r = 0), (c = 0.5, F = 0.5) 
and the fully connected case c = 1 (from top to bottom) . Open symbols are data from 
numerical simulations of the batch process, solid lines are the theoretical predictions of 
Eq. I|53() in the ergodic phase. The vertical dashed line marks the onset of memory for 
(c = 0.5, r = 0.5). No memory onset occurs for (c = 0, F = 0). (Simulation parameters 
are N — 500 agents with data averaged over 50 realisations of the disorder and 500 
time-steps for c = 1 and c = 0.5, N = 1000 agents and 200 realisations for c = 0.) 



replica-symnietry breaking and defines a line in the (a, c)-plane, the so-called AT- line. 
Our analysis follows the lines of fSl IHZI , where the AT-line has been computed for the 
fully connected MG with market impact correction. 

The stability matrix of second derivatives of the free energy has dimension 
n{n — 1) X n{n — 1) is given by 



(54) 




where the sub- matrices A, B and C read 

d\nf) 



A[ah)(cd) 



B, 



(ab){cd) 



d\nf) 



dQabdQcd dSabdScd 

The derivatives with respect to the {Qab} are found as [T31 l3?j 



a 



{ab){cd) 



d\nf) 
dQabdS, 



cd 



A 



{ab){ab) 



A 



(ab){ac) 



A 



{ab){cd) 



-c^[C! + Ci]-^{l-c) 
a a 

- c^Ci [Ci + C2] 
a 

a 



..(55) 

(56) 
(57) 
(58) 
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where Ci 



/3(1+Q) 
a(l+X)2 

B{ab)(ab) 



B(ab){ac) 
B(ab){cd) 

and finally one has 



and C2 
= - a' (3' 



Ci + TT— • Furthermore we find 



[<P'\z)l)^-{{<P\z)l 



{<P'\^)J<P\< 



k); 



k): 



K 



C(ab){cd) = 0!/35acS, 



bd- 



(59) 
(60) 
(61) 

(62) 



We now study fluctuations 6Qab and 6Sab around the replica symmetric solution, 
which are of the form SSab = x6Qab, with x a proportionality constant J^l- We will 
assume that the perturbation is symmetric, i.e 6Qab = SQba and 6Sab = SSba and that 
it does not affect the diagonal elements so that SQaa = ^Saa = 0. We will here consider 
fluctuations of the form 



6Q 



12 



-{3-n)i2-n)y 



(63) 

(64) 
(65) 



SQib = 5Q2b = ^iS-n)y 6^(1,2} 

SQab =y a, 6 ^{1,2}, 

corresponding to the so-called 'replicon' mode |^ E3] . 

In the limit n -^ the corresponding eigenvalues are found to be fSJ EZI 

A± = ~iu + v)± ^y^iu-vy + A, (66) 

where 



u 



+ 



a^(l + x)^ O- 



2 ' 



a(3U({<p'\z).-{<p\zY 



Now, A_ never changes sign, so that the instability sets in when A^ 
when uv = 1, i.e. when 



lim P^ 



(^^14. 



1^): 



1 



(67) 
0. This happens 

(68) 



,tt(l + x)^ a 

It remains to evaluate the averages on left hand side. This is conveniently done by 
introducing F^iji) = (3~^ log J_j^ (^0g-/3Vz(?i)+ft./3(/) ^^^^ upon taking derivatives with respect 
to h ^l^. After some algebra we flnally flnd the following condition for the AT- line 



X 



+ 1 



+ (l-c)(l-x). 



(69) 



[l + X? ' J 1 + X 

This coincides with the MO-line obtained from the dynamics (jSO)), provided we set F = 1 
in the dynamical calculation. A comparison of Eq. (J3T|) and (jHSI) demonstrates that the 
minima of H(. obtained from the replica-symmetric theory become unstable precisely at 
the zero-crossing of He-, as illustrated in Fig. |21 
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Figure 4. Phase diagram in the (a, c)-plane. The hnes separate phases with memory 
at low-a from phases without long-term memory and indicate the location of the 
transition for T = 0.25 (dot-dashed hne), T = 0.5 (dashed), T = 0.75 (dotted) and 
r = 1.0 (solid line). The solid line (F = 1) coincides with the AT-line obtained from 
the replica calculation. The cross marks the critical point of the fully connected MG 
at ar = 0.3374 . . .. 



5. Phase diagram and discussion 

The resuhing phase diagram is shown in Fig. EJ We report the transition lines in the 
{a, c)-plane for different fixed values of F > 0. They separate an ergodic phase with weak 
long-term memory at high values of a from a phase with memory for low a. For F = 1 
the replica symmetric ground state of H^ is stable to the right of the MO(=AT)-line. 
Assuming that x remains finite we find that the condition for the MO-line (|3U|) is given 
by 1 — c + c/{l + xY = for F = and that hence no onset of memory occurs in the 
case of fully asymmetric dilution as the left-hand side is always positive. We find that 
the values of ado, F) approach the critical point ac = 0.3374 ... of the fully connected 
MG continuously in the limit c — > 1. Note that the parameter F is meaningless in the 
fully connected case c = 1. 

To give further support for the picture of memory-onset we follow J7j and measure 
the distance d = N~^ X]i(0« ~ 0i)^ between two microscopic stationary states obtained 
from simulations of two copies of the system for an identical realisation of the disorder, 
but starting from slightly different initial conditions. In this expression 0, and (p'^ are 
the long time averages of sgn[gi] and sgn[g^] in the stationary state, respectively. In 
Fig. El we report the average distance c? as a function of a for different values of the 
parameters (c, F). For large a the two copies end up in the same microscopic state so 
that d = indicating that the long-term memory is weak. Below the predicted onset of 
memory the assumption of weak long-term memory is broken, and we find d > so that 
the final microscopic stationary state depends on the initial conditions. While the data 
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reported in Fig. qualitatively supports the picture of a continuous onset of memory, 
a verification of the precise point of memory-onset by measuring d in simulations turns 
out to be difficult due to finite-size effects. Finally, we find that the two copies end up 
in the same state if the perturbation is applied at much later times, so that we indeed 
conclude that limj/^oo G{t') = 0. 

We conclude this section by reporting results for the magnitude of the fiuctuations 
of the total bid A{t) in Fig. IHl o"^ = (^^)(j^e measures the global efficiency of the 
market; the better supply and demand match, the smaller a^ and the more efficient 
the markt. By construction < A >time= 0. Note that in our model a"^ measures the 
fluctuations of the total bid and not of the local bids Ai perceived by the individual 
agents. The volatility in the stationary state is found as [Sj 

a' = l\im [{l + G)-\E + C){l + G^)-\. (70) 



Following the lines of [H| it is possible to flnd an approximate expression for the volatility 
in terms of the persistent order parameters (p and x? which holds in the ergodic phase: 

As shown in Fig. IHl this approximation is in very good agreement with numerical 
simulations of the batch process. 

While the stationary volatility in the fully connected MG started from zero initial 
conditions exhibits a minimum at ac = 0.33. . ., we flnd an increasing function o"^(a) 
for diluted games, see left panel of Fig. IHl Although only the case c = 0.25, F = 0.75 
is reported in Fig. IHl we flnd very similar curves for other values of c < 1 and F. 
Analogous behaviour of a^ was reported for games with market impact correction [0]. 
We observe that despite the memory-effects no signiflcant dependence of the volatility 
on the initial conditions is found in dilute games. This is in sharp contrast with the 
standard MG, where one flnds stationary states in which volatility cr^ diverges as a -^ 
for so-called tabula rasa starts, qi{0) = for all i and low- volatility solutions for strongly 
biased starts, \qi{0)\ = 0{1). In the dilute game, only low-volatility states appear to 
be realised. The right panel of Fig. IHl demonstrates that the volatility is discontinuous 
as c t 1 for flxed a < adc = 1) = 0.3374. . .. In fact, depending on a the jump can 
extend to several orders of magnitude. Again, very similar behaviour has been reported 
in MGs with market-impact correction [Oj. 

Finally, we have verifled in numerical simulations that the behaviour of the model 
does not change much, if the batch update rule (JD) is replaced by a dilute version of the 
on-line MG, with random external information (see Eq. ^ for the deflnition of the fully 
connected on-line MG). We do not report the numerical data here, but would only like 
to remark that order parameters in the ergodic stationary state such as the persistent 
correlation Q follow the same curves as the corresponding observables of the batch game 
(as displayed in Fig. H}, and that the phase diagram does not appear to be sensitive to 
the choice of on-line or batch learning rules. The volatilities of the dilute on-line and 
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Figure 5. Average distance d between the stationary states of two identical copies 
of the system as a function of a. All runs are started from zero initial conditions. 
Open markers are obtained by applying a small perturbation at i = (circles: c = 0.5, 
squares: c = 0; F = 1 in both cases). The vertical dashed lines indicate the location 
of the onset of memory, Eq. ((301 • The full markers are obtained by perturbing the 
system at a later time t = 500. All simulations are run up to 500 batch steps after the 
perturbation is applied. 10 runs with different random pertm-bations are generated 
per disorder sample and the average is taken over all pairwise distances. Results are 
then averaged over at least 20 realisations of the disorder. 



batch games differ slightly in their quantitative values, but their qualitative behaviour 
as a function of a, c and F coincides. In particular, for on-line games, we find only low 
volatility solutions for low a and c < 1, and a jump in the volatility as c t 1 for small 
enough fixed values of a, similar to the data displayed for the batch game in Fig. IHb)- 
These findings are consistent with the results of [22], where it was observed that order 
parameters such as Q and in the stationary state are identical in the fully connected 
on-line and batch MGs, and that only slight quantitative differences are present in their 
respective volatilities. 

6. Conclusions 



In summary, we have presented static and dynamical analyses of the dilute batch MG 
with random external information. Using a generating functional approach we have 
first solved the dynamics of the game. Assuming time-translation invariance, finite 
integrated response and weak long-term memory we have computed the persistent 
order parameters in the stationary state. Numerical simulations confirm these findings 
convincingly. Standard methods can be employed to obtain a satisfactory approximation 
for the magnitude of the global market fluctuations of the model. 
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Figure 6. Left: Volatility a^ vs a for c = 0.25, F ~ 0.75 (squares). Markers represent 
numerical simulations with TV — 1000 players, averaged over 20 samples of the disorder. 
Open symbols are for tabula rasa starts, (?i(0) = 0, full markers for biased starts, 
|(7i(0)| = 10. The vertical dashed line marks the breakdown of the ergodic theory for 
c = 0.25, r — 0.75. The solid line to the right is the approximation of Eq. (|71ll for 
c = 0.25, r = 0.75. The circles are for comparison and show the results of the standard 
batch MG, c = 1. cr^ = 1 is the random trading limit. Right: a^ vs c at fixed a = 0.2 
for r = (circles), F = 0.5 (squares)and F = 1.0 (diamonds), simulations started from 
zero initial conditions. The solid line is the approximation of H71|) for the case F = 0, 
in which the long-term memory is weak at a = 0.2, so that the ergodic theory applies. 
For F = 0.5 and F = 1 the fixed value a = 0.2 is below the onset of memory. 



The study of the dynamics is complemented by the rephca analysis of the statics 
of the game with fully symmetric dilution. We find that the resulting equations for the 
order parameters agree with the ones obtained from the dynamics. 

Similar to studies of MGs with market impact correction a condition for the 
breakdown of weak long-term memory can be derived from the dynamics, and a 
continuous onset of memory is found at finite integrated response. The resulting MO- 
line agrees with the AT-line obtained from the statics, marking the onset of instability 
of the replica-symmetric theory. While the microscopic stationary state of the present 
model below the transitions depends on the state from which the dynamics is started, 
macroscopic observables such as the volatility appear to be mostly insensitive to initial 
conditions. This indicates that below the transition many microscopic stationary states 
exist, but all with the same or nearly the same global order parameters. Simulations of 
the MG with market impact correction reveal similar behaviour. In both models, the 
dilute MG presented in this paper and the model with market impact correction, the 
microscopic update rules are such that the players use individual bids Ai(t) to update 
their strategy scores, as opposed to the common global bid A{t) in the fully connected 
model without impact correction. Based on the above geometrical considerations one 
might speculate that other variants of the MG with this property might also exhibit 
replica symmetry breaking and the onset of long-term memory at finite integrated 
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response. 

The dilute model shares two other features with the MG with market-impact 
correction: the discontinuity in o"^ as the special case of the conventional game is 
approached in its non-ergodic phase, and the absence of a symmetric phase with 
vanishing predictability. 

We believe that the dilute model is an intrinsicially interesting model from the point 
of view of statistical mechanics and hope that the present contribution might serve as 
a starting point for further analytical studies. For example an approximate or exact 
solution might be attempted in the regime of broken weak long-term memory, but with 
finite integrated response. It might also be interesting to apply the recently developed 
methods to study the dynamics of disordered systems with finite connectivity O |^ to 
MGs with a finite number of connections per agent and to understand the consequences 
for the phase diagram. 

While the present model is designed to be accessible by the tools of equilibrium and 
non-equilibrium statistical mechanics and was not primarily devised as a realistic model 
of a market, there is currently much interest in the interplay between local connectivity 
and global competition in networks of agents fIE\ 1^ . The work on the dilute MG 
presented in this paper should therefore be seen as an intermediate step towards a 
better understanding of more elaborate models. Further developments of the current 
analytical theory might for example include dynamically evolving networks, inter-agent 
communication or the introduction of real local histories. 
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